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Abstract 

This document is part of a series of near real-time weekly influenza forecasts made during the 
2012-2013 influenza season. Here we present results of a forecast initiated following assimila- 
tion of observations for Week 5 1 (i.e. the forecast begins December 23, 2012) for municipalities 
in the United States. The forecast was made on December 28, 2012. Results from forecasts 
initiated the four previous weeks (Weeks 47-50) are also presented. Predictions generated with 
an alternate SIRS model, run without absolute humidity forcing (no AH), are also presented. 



1 Background 

This record is part of an evolving series of real-time forecasts developed during the 2012-2013 
influenza season for the United States. Additional documentation of earlier forecasts for this season 
have also been posted ( |Shaman et al.[ |2012a|b[ ). 



Forecast skill is calculated for individual cities, as well as for census divisions (regions) and all 
cities in aggregate, from retrospective forecasts made for the 2003-2004 through 201 1-2012 seasons, 
excluding the pandemic years 2008-2009 and 2009-2010 (which will need to be handled separately 
in the future). The forecast methods are similar to those described in Shaman and Karspeck| ( 2012] ). 



Based on the relationship between prediction accuracy and ensemble spread of these retrospective 
forecasts we can assign calibrated confidences to our current predictions. 

Figure [T] shows this relationship between prediction accuracy and ensemble spread for all cities 
in aggregate using an SIRS model with climatological AH forcing and a factor of 5 mapping. Overall 
the relationship is informative; however, for all lead times there is a basic plateau of skill once the 
ensemble log variance drops below 2.5 to 3 weeks 2 . 
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Public Health, Columbia University, 722 West 168th Street, Rosenfield Building, Room 1104C, New York, NY 10032. 
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Figure 1 : Plot of ensemble mode forecast accuracy versus ensemble spread measured as log ensem- 
ble variance +1. Left) 1 14 cities in aggregate. The runs are binned in increments of 0.25 units and 
stratified by forecast lead time: 1-3 weeks (red), 4-6 weeks (cyan), 7-9 weeks (blue), 10+ weeks 
(magenta). Right) Same as left, but the 1 14 cities grouped by census region. 

When the cities are grouped by region, there is some heterogeneity. Some regions (e.g. West 
North Central) show marked improvement of forecast accuracy/skill with decreasing spread across 
all lead times. Other regions show much more limited skill-the Mountain region only has skill at 
1-3 weeks, and the East North Central has problems at 1-3 weeks. 

2 2012-2013 Forecast 

The forecasts are in fact complicated as the target-i.e. the ILI+ observations used for assimilation-is 
changing. That is, the CDC census division influenza positive tests are preliminary, and can (and 
do) change as more reports are received. As a result of this, the observed peak may actually change. 
This shifting can be seen in comparison of the ILI+ plotted last week (with information through 
Week 50) versus the current week (with information through Week 51, Figure [2]). For instance, last 
week for Atlanta, ILI+ during Week 49 was clearly higher than during Week 50. This week, the 
numbers have been revised and Week 50 is higher than Week 49 (and Week 51, is ever so slightly 
higher than Week 50). 
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Figure 2: Time series of: Left) Week 50 estimates of Weeks 38-50 ILI+ and Right) Week 51 esti- 
mates of Weeks 40-51 ILI+ for the 2012-2013 season. ILI+ is Google Flu Trends weekly municipal 
ILI estimates times CDC census division influenza positive rates. 

2.1 Week 51 Forecast 

The Week 51 forecast (initiated December 23, 2012) predicts peaks for Atlanta Week 49-50, 1-2 
week in the past (Figure [3] and [4]). This is shifted from the prior week forecast (Week 50), which was 
firmly on Week 49 (Figure [5]). Of course at that time, Week 49 was higher than Week 50, and now it 
is the reverse. 

Basically, the distribution for Atlanta has shifted slightly from consistently favoring Week 49 
(Figure [6]) to a more even split between predictions of peak during Week 49 and Week 50 (Figure 
[4]). However, as Week 51 is currently higher for ILI+ than either Week 49 and 50, unless the peak 
shifts back, the Atlanta forecasts of Week 49 (including prior weeks) will be off more than the ± 1 
margin of error. 

The current forecast for Chicago is for a peak during Week 50 (Figure [3]). This is a slight 
shift from the Week 49-50 peak prediction made last week (Figure [5]). Given that the Week 51 ILI+ 
observation is much higher than Week 50, predictions of peak during Week 49 are outside the margin 
of error. Again, the forecasts are further challenged by the changes in prior week observations; 
Chicago's Week 50 ILI+ changed quite a bit from last week to this, having increased more than 12%, 
which may affect model optimization and prediction of the evolving trajectory of the outbreak. 

Dallas is again predicted to peak during Week 50, as are Memphis, St. Louis, and Houston. 
These are all in line with the prior weeks predictions. All 4 of these cities currently peak during 
Week 50. 

Both New York City and Miami have predicted peaks during Weeks 51 and 52 (the week past 
or the current week ending December 29, 2012). These are roughly similar to the prior weeks 
predictions (Table [T]). In both cases, these are slight shifts in the distribution of predictions from 
the prior week. And in both cases, the Week 5 1 prediction has greater confidence. Miami currently 
appears to peak during Week 50, New York is still rising (Figure [2]). 

Denver and San Francisco are now predicted to peak during Week 52. These are consistent with 
the prior week forecasts (Table [T]). Los Angeles and Seattle are predicted to peak during Weeks 52 
and 53. This is the same as before for Seattle, but a drift farther into the future for Los Angeles. 
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Table 1: Summary of weekly model predictions at 12 select cities. Weeks are labeled consecutively 
(Week 1 of 2013 is Week 53, etc.). Predictions were initiated at the end of Weeks 47, 48, 49, 50 and 
51. The range of prediction confidences, derived from municipal, regional and national calibrations, 
are given in parentheses. 



City 


weeK j 1 


WeeK jU 


\\J,~. ,-.1 , AC\ 

WeeK 4y 


\\/,-. 1 . A O 

WeeK 4o 


WeeK 4 / 




Prediction 


Prediction 


Prediction 


Prediction 


Prediction 


Los Angeles 


ci co /i c nr\m \ 

51-52 (35-60%) 


52 (50-95%) 


ci co /ic c\f\rrf \ 

51-52 (35-90%) 


C I CO /^A CCCrf \ 

51-52 (20-55%) 


C I / 1 C O f\fTl \ 

51 (15-30%) 


San Francisco 


JZ (ZJ-^J 70 ) 


Qcca,\ 


Jl-jZ (Zj-^-V 70) 


ci nn QCCK,\ 


JU-Jl ^Zj-uUVcJ 


Denver 


52 (50-99%) 


52 (20-60%) 


52 (20-55%) 


51-52 (0-55%) 


51 (10-30%) 


Miami 


51-52 (30-99%) 


51 (40-60%) 


51 (40-99%) 


50-51 (40-55%) 


50-51 (0-45%) 


Atlanta 


49-50 (80-99%) 


49 (80-99%) 


49 (90-99%) 


49 (80-95%) 


49 (80-95%) 


Chicago 


50 (55-95%) 


49-50 (55-95%) 


49 (55-95%) 


49 (35-80%) 


49 (35-80%) 


St. Louis 


50 (80-99%) 


51 (85-99%) 


50-51 (80-99%) 


50 (85-99%) 


51 (30-90%) 


New York City 


51-52 (20-99%) 


52 (25-99%) 


51 (25-99%) 


52-53 (25-60%) 


53-54 (25-55%) 


Memphis 


50 (70-99%) 


51 (20-80%) 


50 (20-80%) 


50(15-80%) 


49-50 (15-55%) 


Dallas 


50 (65-95%) 


50 (65-90%) 


49-50 (65-85%) 


49 (50-75%) 


49 (40-85%) 


Houston 


50 (70-95%) 


50 (75-90%) 


50 (50-60%) 


50 (50-60%) 


49 (50-85%) 


Seattle 


51-52 (20-60%) 


52-53 (0-55%) 


52-53 (5-55%) 


51-52 (5-55%) 


51 (5-35%) 



2.2 Week 51 Forecast - No AH 

Forecasts initiated after assimilation of Week 51 observations at the beginning of Week 52 (Decem- 
ber 23, 2012) using an SIRS model without absolute humidity forcing produce generally similar 
predictions (Figure|7]) as seen with the SIRS model with climatological AH forcing. The predictions 
for the 12 focus cities using the SIRS model without AH forcing are summarized in Table [2]). 
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Table 2: Summary of weekly model predictions at 12 select cities using an SIRS model without 
absolute humidity forcing. Weeks are labeled consecutively (Week 1 of 2013 is Week 53, etc.). Pre- 
dictions were initiated at the end of Weeks 48, 49, 50 and 51. The range of prediction confidences, 
derived from municipal, regional and national calibrations, are given in parentheses. 



City 


Week 51 


Week 50 


Week 49 


Week 48 




Prediction 


Prediction 


Prediction 


Prediction 


Los Angeles 


52 (25-50%) 


51 (25-50%) 


50-51 (25-50%) 


50 (25-50%) 


San Francisco 


52 (30-50%) 


51 (30-60%) 


50-51 (30-60%) 


50 (30-50%) 


Denver 


52 (50-99%) 


52 (50-80%) 


51-52 (40-85%) 


51 (40-60%) 


Miami 


50 (55-80% 


50-51 (40-80%) 


50(10-99%) 


50 (5-65%) 


Atlanta 


49-50 (80-99%) 


49 (80-99%) 


49 (90-99%) 


49 (25-95%) 


Chicago 


50 (45-95%) 


49 (55-95%) 


49 (55-95%) 


49 (25-65%) 


St. Louis 


50 (70-99%) 


51 (80-95%) 


50 (80-95%) 


50 (35-95%) 


New York City 


52 (30-60%) 


51-52 (30-60%) 


51 (30-60%) 


52-53 (25-60%) 


Memphis 


50 (70-99%) 


50 (45-99%) 


50(10-90%) 


49-50 (15-55%) 


Dallas 


50 (80-95%) 


50 (65-90%) 


49 (15-85%) 


49 (40-80%) 


Houston 


50 (70-90%) 


50 (80-95%) 


50 (60-70%) 


49-50 (30-70%) 


Seattle 


52 (20-65%) 


51-52 (20-50%) 


51-52 (20-45%) 


51 (0-50%) 
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Figure 3: Ensemble mode peak week predictions initiated December 23, 2012, following assimila- 
tion of Week 51 observations, for 12 cities plotted as a function of probability/confidence calibrated 
from historical city, regional and national prediction accuracy. 
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Figure 4: Histograms of peak predictions from 25 200-member ensemble forecasts made beginning 
the start of Week 52 (December 23, 2012) for select cities. The distributions show the ensemble 
spread among peak predictions. 
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Figure 5: Ensemble mode peak week predictions initiated December 16, 2012, following assimila- 
tion of Week 50 observations, for 12 cities plotted as a function of probability/confidence calibrated 
from historical city, regional and national prediction accuracy. 
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Figure 6: Histograms of peak predictions from 25 200-member ensemble forecasts made beginning 
the start of Week 51 (December 16, 2012) for select cities. The distributions show the ensemble 
spread among peak predictions. 
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Figure 7: Ensemble mode peak week predictions initiated December 23, 2012, following assimila- 
tion of Week 51 observations using an SIRS model without AH forcing, for 12 cities plotted as a 
function of probability/confidence calibrated from historical city, regional and national prediction 
accuracy. 
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